On Higher Order Noise Immune Perceptrons
نویسنده
چکیده
This paper details a systematic method for significantly enhancing the noise margins of very fast threshold gates. The method is based on adding nonlinear terms determined from the Boolean form of the linearly separable (threshold) function to be implemented. It follows that linearly separable functions can be computed with high noise immunity by higher order perceptrons. Simulation results support our theoretical claims. Finally, two methods for drastically reducing the dissipated power of such higher order perceptron gates down to <50%, and respectively <10% are suggested.
منابع مشابه
Oracle Separation of Complexity Classes and Lower Bounds for Perceptrons Solving Separation Problems
In the rst part of the paper we prove that, relative to a random oracle, the class NP has innnite sets having no innnite Co-NP-subsets (Co-NP-immune sets). In the second part we prove that perceptrons separating Boolean matrices in which each row has a one from matrices in which many rows (say 99% of them) have no ones must have large size or large order. This result partially strengthens one-i...
متن کاملBounds on the Degree of High Order Binary Perceptrons Bounds on the Degree of High Order Binary Perceptrons
High order perceptrons are often used in order to reduce the size of neural networks. The complexity of the architecture of a usual multilayer network is then turned into the complexity of the functions performed by each high order unit and in particular by the degree of their polynomials. The main result of this paper provides a bound on the degree of the polynomial of a high order perceptron,...
متن کاملBoosting Parallel Perceptrons for Label Noise Reduction in Classification Problems
Boosting combines an ensemble of weak learners to construct a new weighted classifier that is often more accurate than any of its components. The construction of such learners, whose training sets depend on the performance of the previous members of the ensemble, is carried out by successively focusing on those patterns harder to classify. This fact deteriorates boosting’s results when dealing ...
متن کاملImage denoising with multi-layer perceptrons, part 2: training trade-offs and analysis of their mechanisms
Image denoising can be described as the problem of mapping from a noisy image to a noise-free image. In Burger et al. (2012), we show that multi-layer perceptrons can achieve outstanding image denoising performance for various types of noise (additive white Gaussian noise, mixed Poisson-Gaussian noise, JPEG artifacts, salt-and-pepper noise and noise resembling stripes). In this work we discuss ...
متن کاملBounds on the degree of high order binary perceptrons
High order perceptrons are often used in order to reduce the size of neural networks The complexity of the architecture of a usual multilayer network is then turned into the complexity of the functions performed by each high order unit and in particular by the degree of their polynomials The main result of this paper provides a bound on the degree of the polynomial of a high order perceptron wh...
متن کامل